Papers by Jasper Schulze Buschhoff
Can Continual Pretraining Bridge the Performance Gap between General-purpose and Specialized Language Models in the Medical Domain? (2026.acl-long)
Copied to clipboard
Niclas Doll, Jasper Schulze Buschhoff, Shalaka Satheesh, Hammam Abdelwahab, Héctor Allende-Cid, Katrin Klug
| Challenge: | specialized models have a large potential for translation and translation, but they lack the integration of domainspecific knowledge and terminology into clinical workflows. |
| Approach: | They construct a German medical corpus to continuously pre-train and merge three well-known LLMs and use it to improve model performance. |
| Outcome: | The proposed model family significantly outperforms the mistral-Small-24B-Instruct model family on German medical benchmarks. |